Development of a practical and mobile brain-computer communication device for profoundly paralyzed individuals

Thesis (Ph.D.)--Boston UniversityBrain-computer interface (BCI) technology has seen tremendous growth over the past several decades, with numerous groundbreaking research studies demonstrating technical viability (Sellers et al., 2010; Silvoni et al., 2011). Despite this progress, BCIs have remained primarily in controlled laboratory settings. This dissertation proffers a blueprint for translating research-grade BCI systems into real-world applications that are noninvasive and fully portable, and that employ intelligent user interfaces for communication. The proposed architecture is designed to be used by severely motor-impaired individuals, such as those with locked-in syndrome, while reducing the effort and cognitive load needed to communicate. Such a system requires the merging of two primary research fields: 1) electroencephalography (EEG)-based BCIs and 2) intelligent user interface design. The EEG-based BCI portion of this dissertation provides a history of the field, details of our software and hardware implementation, and results from an experimental study aimed at verifying the utility of a BCI based on the steady-state visual evoked potential (SSVEP), a robust brain response to visual stimulation at controlled frequencies. The visual stimulation, feature extraction, and classification algorithms for the BCI were specially designed to achieve successful real-time performance on a laptop computer. Also, the BCI was developed in Python, an open-source programming language that combines programming ease with effective handling of hardware and software requirements. The result of this work was The Unlock Project app software for BCI development. Using it, a four-choice SSVEP BCI setup was implemented and tested with five severely motor-impaired and fourteen control participants. The system showed a wide range of usability across participants, with classification rates ranging from 25-95%. The second portion of the dissertation discusses the viability of intelligent user interface design as a method for obtaining a more user-focused vocal output communication aid tailored to motor-impaired individuals. A proposed blueprint of this communication "app" was developed in this dissertation. It would make use of readily available laptop sensors to perform facial recognition, speech-to-text decoding, and geo-location. The ultimate goal is to couple sensor information with natural language processing to construct an intelligent user interface that shapes communication in a practical SSVEP-based BCI

CNS Technology Website Administrative Guide (Version 1.0)

Air Force Office of Scientific Research (F49620-01-1-0397); National Science Foundation (SBE-0354378); Office of Naval Research (N00014-01-1-0624)

Examining sensory ability, feature matching, and assessment-based adaptation for a brain-computer interface using the steady-state visually evoked potential

This is an Accepted Manuscript of an article published by Taylor & Francis in Disability and Rehabilitation: Assistive Technology on 01/31/2018, available online: http://www.tandfonline.com/10.1080/17483107.2018.1428369.PURPOSE:We investigated how overt visual attention and oculomotor control influence successful use of a visual feedback brain-computer interface (BCI) for accessing augmentative and alternative communication (AAC) devices in a heterogeneous population of individuals with profound neuromotor impairments. BCIs are often tested within a single patient population limiting generalization of results. This study focuses on examining individual sensory abilities with an eye toward possible interface adaptations to improve device performance. METHODS: Five individuals with a range of neuromotor disorders participated in four-choice BCI control task involving the steady state visually evoked potential. The BCI graphical interface was designed to simulate a commercial AAC device to examine whether an integrated device could be used successfully by individuals with neuromotor impairment. RESULTS: All participants were able to interact with the BCI and highest performance was found for participants able to employ an overt visual attention strategy. For participants with visual deficits to due to impaired oculomotor control, effective performance increased after accounting for mismatches between the graphical layout and participant visual capabilities. CONCLUSION: As BCIs are translated from research environments to clinical applications, the assessment of BCI-related skills will help facilitate proper device selection and provide individuals who use BCI the greatest likelihood of immediate and long term communicative success. Overall, our results indicate that adaptations can be an effective strategy to reduce barriers and increase access to BCI technology. These efforts should be directed by comprehensive assessments for matching individuals to the most appropriate device to support their complex communication needs. Implications for Rehabilitation Brain computer interfaces using the steady state visually evoked potential can be integrated with an augmentative and alternative communication device to provide access to language and literacy for individuals with neuromotor impairment. Comprehensive assessments are needed to fully understand the sensory, motor, and cognitive abilities of individuals who may use brain-computer interfaces for proper feature matching as selection of the most appropriate device including optimization device layouts and control paradigms. Oculomotor impairments negatively impact brain-computer interfaces that use the steady state visually evoked potential, but modifications to place interface stimuli and communication items in the intact visual field can improve successful outcomes

The Unlock Project: A Python-based framework for practical brain-computer interface communication “app” development

In this paper we present a framework for reducing the development time needed for creating applications for use in non-invasive brain-computer interfaces (BCI). Our framework is primarily focused on facilitating rapid software “app” development akin to current efforts in consumer portable computing (e.g. smart phones and tablets). This is accomplished by handling intermodule communication without direct user or developer implementation, instead relying on a core subsystem for communication of standard, internal data formats. We also provide a library of hardware interfaces for common mobile EEG platforms for immediate use in BCI applications. A use-case example is described in which a user with amyotrophic lateral sclerosis participated in an electroencephalography-based BCI protocol developed using the proposed framework. We show that our software environment is capable of running in real-time with updates occurring 50–60 times per second with limited computational overhead (5 ms system lag) while providing accurate data acquisition and signal analysis

Cellular plasticity in response to suppression of storage proteins in the Brassica napus embryo

The tradeoff between protein and oil storage in oilseed crops has been tested here in oilseed rape (Brassica napus) by analyzing the effect of suppressing key genes encoding protein storage products (napin and cruciferin). The phenotypic outcomes were assessed using NMR and mass spectrometry imaging, microscopy, transcriptomics, proteomics, metabolomics, lipidomics, immunological assays, and flux balance analysis. Surprisingly, the profile of storage products was only moderately changed in RNA interference transgenics. However, embryonic cells had undergone remarkable architectural rearrangements. The suppression of storage proteins led to the elaboration of membrane stacks enriched with oleosin (sixfold higher protein abundance) and novel endoplasmic reticulum morphology. Protein rebalancing and amino acid metabolism were focal points of the metabolic adjustments to maintain embryonic carbon/nitrogen homeostasis. Flux balance analysis indicated a rather minor additional demand for cofactors (ATP and NADPH). Thus, cellular plasticity in seeds protects against perturbations to its storage capabilities and, hence, contributes materially to homeostasis. This study provides mechanistic insights into the intriguing link between lipid and protein storage, which have implications for biotechnological strategies directed at improving oilseed crops

AVIATR - Aerial Vehicle for In-situ and Airborne Titan Reconnaissance A Titan Airplane Mission Concept

We describe a mission concept for a stand-alone Titan airplane mission: Aerial Vehicle for In-situ and Airborne Titan Reconnaissance (AVIATR). With independent delivery and direct-to-Earth communications, AVIATR could contribute to Titan science either alone or as part of a sustained Titan Exploration Program. As a focused mission, AVIATR as we have envisioned it would concentrate on the science that an airplane can do best: exploration of Titan's global diversity. We focus on surface geology/hydrology and lower-atmospheric structure and dynamics. With a carefully chosen set of seven instruments-2 near-IR cameras, 1 near-IR spectrometer, a RADAR altimeter, an atmospheric structure suite, a haze sensor, and a raindrop detector-AVIATR could accomplish a significant subset of the scientific objectives of the aerial element of flagship studies. The AVIATR spacecraft stack is composed of a Space Vehicle (SV) for cruise, an Entry Vehicle (EV) for entry and descent, and the Air Vehicle (AV) to fly in Titan's atmosphere. Using an Earth-Jupiter gravity assist trajectory delivers the spacecraft to Titan in 7.5 years, after which the AVIATR AV would operate for a 1-Earth-year nominal mission. We propose a novel 'gravity battery' climb-then-glide strategy to store energy for optimal use during telecommunications sessions. We would optimize our science by using the flexibility of the airplane platform, generating context data and stereo pairs by flying and banking the AV instead of using gimbaled cameras. AVIATR would climb up to 14 km altitude and descend down to 3.5 km altitude once per Earth day, allowing for repeated atmospheric structure and wind measurements all over the globe. An initial Team-X run at JPL priced the AVIATR mission at FY10 $715M based on the rules stipulated in the recent Discovery announcement of opportunity. Hence we find that a standalone Titan airplane mission can achieve important science building on Cassini's discoveries and can likely do so within a New Frontiers budget